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Abstract 

A short  ccaparlson  between  Che  dif- 
ferent state-space  models  Is  presented.  Ve  discuss 
proper  definitions  of  state,  controllability  and 
observability  and  their  relation  to  Plnlrjallty  of 
2-D  systems.  We  also  present  new  circuit  realiza- 
tions and  2-D  digital  filter  hardware  Implementa- 
tions of  2-D  transfer  functions,  as  well  as  a 2-D 
generalization  of  Levinson's  algorithm. 


1.  Introduction 

Attasl,  Fomaslnl-Marcheslnl,  Clvone— Roesser 
have  proposed  different  state-space  models  for  2-D 
systems  and  have  suggested  some  extensions  of  Cho 
usual  1-D  notions  of  controllability,  observability 
and  minimality  to  the  2-D  case.  However,  these  re- 
sults are  not  quite  satisfactory;  they  either  lack 
motivation  for  the  state-space  models  Introduced  or 
the  notion  of  state-space  Is  Improperly  defined. 

In  this  paper  and  In  [18],  we  tried  to  provide 
answers  to  these  questions  from  a practical  as  well 
as  algebraic  standpoint.  We  start  with  a discussion 
of  all  the  current  models  based  on  a practical  (cir- 
cuit-oriented) point  of  view  and  on  a proper  defi- 
nition of  state.  Since  the  other  models  can  be 
Imbedded  In  the  Clvone-Roesser  model.  It  appears  to 
be  the  most  satisfactory  one. 

From  the  circuit  point  of  view,  we  present  In 
Section  3 an  Implementation  of  2-D  transfer  func- 
tions using  two  types  of  dynamic  elements  - hori- 
zontal delay  elements  z”l  and  vertical  delay  ele- 
ments -u"!.  The  hardware  implementation  of  2-D  digi- 
tal filters  for  imaging  systems  Is  also  discussed 
in  Section  3.. 

An  algebraic  approach  based  on  elgencurves  and 
elgcncones  enables  us  In  Section  5 to  Introduce  the 
concept  of  modal  controllability  (observability) . 
we  show  that  a system  Is  minimal  If  and  only  If  It 
Is  modally  observable  and  controllable. 


This  work  was  supported  by  the  Advanced  Re- 
scatch  Projects  Agency  through  the  facilities  at 
Che  Stanford  Artificial  Intelligence  Laboratory  In 
part  by  the  National  Science  Foundation  under  Con- 
tract NSr-Eng75-18952  and  in  part  by  the  Air  Force 
Office  of  Scientific  Research,  AF  Systems  CoRxicnd, 
under  Contract  AF  A4-620-69-C-0101  and  partially  by 
the  Joint  Services  Electronics  Program  under  Con- 
tract X-00014-67-A-0112-0044. 


If  we  are  given  an  Irreducible  transfer  func- 
tion of  order  (n,m),  a state-space  realization  is 
minimal.  If  and  only  If  It  Is  of  size  n + m.  The 
existence  of  such  (n  + m)  (real  or  complex)  state 
realizations  Is  discussed  in  Section  6,  •..•here 
we_provide  a simple  co-ar.tcr  excmplc  2 c real 
.m^cl.  In  tha  Appendix  we  give  a 2-D  generallzatlca 
of  Levinson  s algorithm.  In  conclusion,  it 
appears  that  the  results  obtained  by  the  algebraic 
and  the  practical  approaches  are  quite  compatible. 


2,  State-Space  Models  for  2-D  Systems 

During  recent  years,  several  authors:  Attasl 
[IJ.  [2],  Fornaslnl-Marchcslnl  [3],  [4]  and  Civono- 
Roesser  [bj  have'.propuscd  different  state-space 
models  for  2-D  systems.  In  (4].  Fornaslni  end 
Marcheslnl  were  using  the  algebraic  point  of  view 
of  Nerode  equivalence  and  were  the  first  to  real- 
ize chat  a major  difference  between  1-D  and  2-D 
systems  Is  that  we  can  Introduce  a global  state 
and  a local  state  In  the  2-D  case.  The  global 
state  (which  Is  of  Infinite  dimension  In  general) 
preserves  all  the  past  Information  while  the  local 
state  gives  us  the  size  of  the  recursions  to  be 
performed  at  each  step  by  the  2-D  filter.  However, 
their  state  does  not  obey  a first-order  difference 
equation  (the  notion  of  first  order  difference 
equation  for  linear  systems  on  partially  ordered 
setb  has  been  defined  by  Mullans  and  Elliott  In 
[7]).  Atcasl's  model  [1],  [2]  suffers  from  the 
same  drawback. 

Clvone  and  Roesser 'In  [8]  and  [S]  have  used  a 
"circuit  approach”  to  the  problem  of  state  spare 
realization  for  some  2-D  transfer  functions.  They 
present  a model  In  which  the  local  state  Is  di- 
vided into  an  horizontal  and  a vertical  state 
which  are  propagated  respectively  horizontally  and 
vertically  by  first  order  difference  equations. 

Mltra,  Sagar  and  Pendergrass  gave  a realiza- 
tion for  arbitrary  transfer  functions  la  (9J  by 
presenting  an  Implementation  method  for  2-D  trans- 
fer functions  using  some  delay  elements  z“2  and 
via  an  approach  that  Is  consistent  with  Roesser's 
model.  A detailed  comparison  can  be  found  In  [IS], 
Parc  II. 

N 

3.  Circuit  Realizations  and  Hardware  Designs 

First,  we  can  note  that  the  notion  of  "dynamic 
elements",  "multipliers"  and  "adders"  Is  at  the 
center  of  circuit  theory.  In  the  l-D  discrete-time 
caac,  the  dynamic  elements  used  arc  (time)  delay 
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clcRcnca.  Th«  1-D  realization  problems  have  been 
veil  studied  and,  given  any  transfer  function.  It 
Is  well  knovm  that  the  realization  can  be  readily 
found  in  certain  standard  (e.g.  controller  canoni- 
cal) forms  (11).  For  the  realization  of  a 2-D 
transfer  function,  a major  difference  Is  that  two 
types  of  dynamic  elements  arc  needed  - "horizontal 
dflay  element"  {z“l)  and  "vertical  delay  element" 
Sou  an  important  problem  Is  that  of  how  to 
use  2-D  dynamic  elements,  multipliers  and  adders  to 
realize  a 2-D  digital  filter  with  the  transfer 
function: 


Figure  3.  2:  2-D  Controller  Form  Realization 


a(z"\u‘b 


I b,,  0.-J 

1-0  ^ 


n m . , 

I I *11  z‘V^ 

1-0  J-0 


,(3.1) 


Vc  can  do  this  in  two  steps.  First  we  rewrite 
(3.1)  In  a rational-gain  representation,  l.e. 

..I  b^(u,-l) 

H(z-\«-l)  - ^ (3.2) 

I a (u'^) 

1-0  '■ 

Without  loss  of  generality,  we  can  assume  a..  - 1 
and  we  denote 

ag(M"b  & 1 + 

Thus,  using  the  1-D  realization  technique,  we  write 
down  a realization,  where  the  gains  of  the  siultl- 
pllcrs  ace  represented  In  Flu*!).  y 

Figure  3.1 


The  realization  Is  almost  achlevedi  In  addi- 
tion to  the  n horizontal  delay  elements  we  need 
only  m vertical  delay  elements  to  Implement  the 
feedback  gains  (a.fu"^),  1-0,  l...m)  and  n other 
vertical  delay  elements  to  Implement  the  readout 
gains  {b£(w“l),  1-0,  l...m}.  Thus,  the  complete 
realization  shown  In  Figure  3.2  requires  only  n+2m 
dynamic  elements. 

This  realization  Is  a standard  (canonical) 
one;  Its  structure  Is  very  simple  and  It  involves 
•nly  real  g.ilns.  Note  also  that  we  need  fewer 
dynaulc  elements  Chan  the  Inplcmentatlons  In  [9]. 
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State  Space  Model  Representation 

As  remarked  In  Section  2,  circuit  Implemen- 
tations with  delay  elements  z“!  and  are  In  a 
one-to-one  correspondence  with  state  apace  models 
of  Roesser's  type.  The  output  of  the  s”3  delays 
are  the  horizontal  states  and  the  outputs  of  the 
delays  ace  the  vertical  states . 

Thus,  the  Implementation  of  Figure  3.2  can  be 
transformed  readily  into  the  following  state  space 
swdel. 

nfx.  (i+l,J)  ”1 

1 


yd.J)  ■ 

c x(l,j)  + bQQ«d»J) 

where 

Ki : 

A « A : 

• 

B I 

^1  A *n  " «!  SnO  * ^2  - *ti  “ ^Om  *1 

and 

(BJijAbij-aioboj  , l<l<n.  0ijf«;bQ^tbj,j bj^l' 


A discussion  of  soms  Interesting  properties  of  2-D 
state  space  oodels  can  be  found  in  [18]. 

Hardware  Design  of  2-D  Digital  Filter 


Comparing  (3.8),  (3.9),  It  Is  clear  that 


l 

(1,J):1M+JN  - t 


'l.J 


(3.10) 


The  Idea  of  using  two  types  of  dynamic  ele- 
nents  Is  not  very  abstract;  It  Is  very  natural  In 
delay-differential  systems.  However,  before 
considering  its  practical  application  to  Image  sys- 
tems, two  remarks  have  to  be  made: 

1)  Because  thb  "spatial"  dynamic  elements  seem 
unleplemcncable,  (except  as  Index  operators  In  a 
digital  computer,  for  example,)  we  can  replace  them 
by  time-delay  elements. 

2)  In  order  to  have  a finite  order  description, 
we  shall  only  consider  a bounded  frame  system,  l.e. 
we  assume  that  the  picture  frame  of  Interest  Is  an 
MxN  frame  (with  vertical  width  M and  horlsontal 
length  N). 

Note  that  In  order  to  use  time  delay  elements 
we  need  first  to  find  a way  to  code  a 2-D  spatial 
system  Into  a 1-D  (discrete-time)  system  and  vice 
versa.  Thus  we  shall  propose  the  following  Imple- 
mentation of  a 2-D  filter; 


Since  the  system  Is  a causal  system, 

y^^j  - 0 If  1,)  < 0 . (3.11)  ■ 

Let  us  consider  only  the  Integer  t with 
t - IM+JM  , 1 < N , a < M 

then  (3.10)  and  (3.11)  give 


yt 


- y 


i.j 


since,  for  this  special  case,  the  suirnatlon  set  of 
(3.10)  contains  only  one  nonzero  point.  There- 
fore, we  will  obtain  a bona  fide  output  picture 
inside  the  MxN  frame. 


This  2-D  Image  scanning,  and  display  system  Is 
not  as  complicated  as  It  looks.  It  can  be  simple: 

Example;  Problem:  Design  a 2-D  digital  filter  for 


H(s"^,u"^) 


1 

1+0. 3z"^+0 . 2u~^+0 . lt"^w"^ 


1)  The  Input  scan  generator  codes  the  2-D 
spatial  Input  Into  1-D  (time)  data  according  to 
the  mapping  function  t(.,.) 


wber* 


t(l,J)  - IM  + JH  (3.4) 

M and  H are  relatively  prime  Integers. 


11)  A 1-D  (discrete-time)  digital  filter 
processes  the  1-D  data  generated  by  [l).  This 
subayatem  Is  Implemented  by  replacing  s~l'  by  d , 
erl  by  A In  a 2-D  circuit  realisation  (e.g.  2-D 
controller  fore) . d and  A are  chosen  as 


d ■ d"  ■ M-unlts  delay  element. 


(3.5) 


A a D * M-unlts  delay  element. 

Hi)  The  output  frame  generator  decodes  the 
1-D  (discrete-time)  output  of  the  1-D  digital 
filter  described  above  Into  a 2-D  (discrete-spatial) 
plcCere  according  to  the  Inverse  mapping  of  (3.4). 

(i(t),  J(t))  - (PtmodM,  [t- (PtmodM)N)/M)(3.6) 
where  F is  the  unique  Integer  such  that 

PM  - QM  - 1 and  0<P<M  (3.7) 


Verification:  Let  us  note  the  1-D  (discrete- 
time)  output  will  be 

y(D)  - K(D)  U(D) 


H(s“^,»‘^)u(s"',»“^) 


t I y,  4 « 


-1 


.-'-D^.m-'.D" 


1 i 


I.J 


.-».D",m-W 


(3.8) 


sAere  (yij)  repreaenta  the  2-D  (discrete-spatial) 
eutpet  data  field.  Mote  also  that 


r(o)  A ^ Kg  • 

t 


.-t 


(3.t) 


for  a frame:  MxN  ~ 100x101.  Assume  D-0.01  sis. 
Solution.  (1)  ISC 

In  this  special  frame  (with  H-M+l) , the  Input 
scanning  generator  is  Indeed  very  simple,  as  shown 
in  Figure  3.3. 


Scanning  time:  0.01  ms/plxel  > 1 ms/llne 
Scanning  angle:  4S* 

Pig.  3.4  Input  Scan  Generator  & Output  Frame 
Generator 

(11)  1-D  digital  filter 


Constructing  the  2-D  realization  of  Figure 
3.2  and  then  replacing  z~L  by  d and  u~l  by  A ve 
have  the  1-0  realization  shown  in  Figure  3.4 


(Ill)  ore 

The  output  frane  generator  does  the  reverse  of 
the  ISC.  displaying  Che  picture  instead  of  scanning. 

Dimensionality  of  Global  State 

Considering  a bounded  frame  (MxN)  system.  It 
Is  Interestinj;  to  knew  the  dimension  of  the  global 
state  (or  initial  conditions)  needed  to  process  the 
KxN  “future"  data  field.  Since  vertical  states 
convey  information  vertically,  all  the  vertical 
states  along  the  X-axis  are  necessary  initial  con- 
ditions and  their  dimension  is  nN.  Similarly,  all 
the  horizontal  states  along  the  Y-axis  are  neces- 
sary initial  conditions  (with  dimension  nM)  since 
they  convey  Information  horizontally.  Therefore, 
in  the  bounded  frame  case  a total  number  of  eCi-fnM 
are  needed  to  summarize  the  “past"  Information. 

This  very  same  Idea  can  be  used  again  from  a 
coaputational  point  of  view.  Indeed,  the  number  of  * 
required  storage  elements  for  recursive  computa- 
tions Is  also  equal  to  nM+mN  If  initial  conditions 
are  not  zero.  However,  the  Initial  conditions  aro 
often  zero,  then  the'size  of  storage  required  can 
be  reduced  to  nN  (resp.  nM)  by  storing  the  updated 
data  row  by  row  (resp.  column  by  column).  No 
storage  is  needed  for  the  rest  of  the  Initial  con- 
ditions - r.M  horizontal  states  (resp.  bN  vertical 
states)  - since  they  are  assumed  to  be  zero.  This 
Is  consistent  with  Che  result  of  Read  (12]  derived 
from  a direct  polynomial  approach. 

Another  interesting  observation  concerns  the 
dimension  of  Che  1-D  digital  filter  contained  in 
our  2-0  digital  filter  design  discussed  above. 

Since  it  needs  n M-unlt-delays  and  m N-unit-delays, 
the  corresponding  1-0  state-space  has  also  a dimen- 
sion equal  CO  nM4iaN.  Note  that,  despite  the  high 
dimension  of  the  corresponding  1-D  filter,  its 
high  sparsity  is  very  encouraging  for  further 
studies. 

la  short,  our  studies  on  the  dimensionality  of 
2-0  global  states  have  reached  a consistent  conclu- 
sion from  either  theoretical  or  practical  approaches. 


4.  Global  and  Local  Controllability  and 
Observability 

For  reasons  of  space  we  deferred  this  Section 
to  [18],  part  II. 


5.  Modal  Controllability  (Observability)  sad 
Minimality 

In  the  1-0  case,  the  relative  prioeness  con- 
cepts could  also  be  used  to  define  controllability 
and  observability.  In  (16]  Rosenbrock  proved  that 

A,  B was  controllable  if  and  only  if  zI-A,B 
were  left  coprime. 

C,  A was  observable  if  and  only  If  C,  zI-A 
were  right  coprime. 

This  approach  can  be  generalized  very  easily 
to  2-D  systems  and  will  also  provide  a definition 
of  nlnlmallty. 

Definition  5.1  Let  K(x,u)  - VT“'b  where  V,  T,  0 
are  2-D  plynomial  outrlces.  It  Is  a minimal 
description  of  H(s,u)  if  and  only  if 


V,  T are  right  coprime  and  T,  U are  left  co- 
prisw.  . , 

This  amounts  to  requiring  that  there  is  no  ■ 
cancellation  in  the  2-D  transfer  function  H(z,cd).Dt 
[18]  part  1 we  also  provide  the  important  property' 
that  If  (V,T,U)  and  (Vj,T,,UO  arc  two  minimal 
descriptions  of  H,  |t|  ••  |T^|.  Wc  also  presented 
an  algorithm  to  extract  the  greatest  common  rigl-.t 
(left)  divisor  of  two  polynomial  matrices,  which 
cnablet  us  to  find  a minimal  des.:rlpCion  of  H from 
a nonminlmal  one. 

Pefine  A(z,Ci))  A ((*q^  ®j^)  - A]  - A^^^(z,u)  . 

Then,  in  the  state  space  description  case 


H ■ CA(z,u)~^B  is  minimal  if  and  only  if 

[A(z,(i>),B] 

are  left  coprime 

(5.1) 

and 

(C.A(z,u)] 

are  right  coprime 

(5.2) 

Definition  5.2  (1)  A,B  is  modally  controllable 

if  (S.l)  holds. 

(ii)  C,A  is  modally  observable  if 
(5.2)  holds. 

These  definitions  are  clearly  connected 
to  minimality  but  the  state  space  signifi- 
cance of  controllability  and  observability  disap- 
pears in  this  formulation.  Tills  is  why  we  shall 
give  now  an  equivalent  state-space  characterization 
of  the  notions  of  modal  controllability  and  obser- 
vability . Another  consequence  is  that  for  a 
single  input-single  output  system,  if  H(a,u)  - 

and  if  b and  a are  coprime  with  3 a ■ n 

e Z 

3u)a  - m,  then  if  CAp  (z,u)  is  a minimal  realiza 
tlon  of  H(z,u)  we  mu»  have  |A(z,ai)|>  a(z,u)  and 
hence  p ■ n and  q ■ m. 

Hence  the  validity  of  our  definition  of  mini- 
mality of  a state-space  model  will  depend  on  our 
ability  to  realize  a transfer  function  of  order 
(n,m)  with  n-fm  states.  This  problem  was  considered 
in  Section  6 of  (18],  part  II. 

A consequence  of  the  relative  primeness 
criterion  for  2-D  polynomial  matrices  given  in 
(18],  part  I is  chat  C and  A(s,ii))  are  right 
coprime  if  and  only  if 

tWik  |'A(z,(i))J«  n+m 

for  any  generic  point  ((^i  C2)  *ny  Irreducible 
algebraic  curve  Vi  appearing  in  the  decomposition 
of  V,  the  algebraic  curve  defined  by  |A(z,ui)i  > 0. 
It  is  to  be  noted  that  the  rank  is  considered  over 
the  field  K((i,  (2)*  ^ proof  of  this  is  given  in 

[18],  part  II,  along  with  some  illustrating 
examples . 


6.  Minimality  of  State-Space  Model 

It  is  shown  in  the  last  section  and  in  (18], 
part  II,  that  only  a state-space  realization  with 
order  (n,m)  - l.e.  the  sane  order  as  the  transfer 
function  - can  be  both  modally  controllable  and 
modally  observable.  Now  the  question  is  whether 
such  a realization  exists  at  all. 

The  best  way  to  prove  the  existence  of  such 
realisation  is  by  construction.  Note  that,  in  the 


2-D  state-space  model,  the  particular  tronsfom 


’S, 

X 


0 


X 


(6.1) 


enables  us  to  change  the  basis  of  the  state-space. 
The  matrices  {A,B,C,D)  arc  transformed  to 


A - T A T-1 
C - CT"! 


B - TB 
D-D 


(6.2) 


In  fact.  It  Is  more  convenient  to  work  with  a ca- 
nonical form  under  the  "similarity  transform" 
defined  by  (6.2) . 

In  the  1-D  case,  all  minimal  state-space  model 
can  be  transformed  to  the  controller  canonical  form. 
Similarly,  almost  all  [18]  2-D  state-space  model 
can  be  transformed  to  the  following  modal  controller 
form  (a,  B,  C,}  (assuming  D - 0) 

[Z'-e.a'n  * A, , ~|  B'-  (e^  lef  ) 

.-..H ^ (6.3) 

^21  : V£l20m_  ^ " ^-nol-Om^ 

where  Z . ,ja.  ,b.  ,(£.  were  defined  In  (3.3)  and  the 
entries  of  A^z  and  Azx  are  to  be  chosen  such  that 


dec[A(s,(o)]  - a(s,u) 


and 


det 


A(z,u) 

b" 

-C 

.0. 

b'(z,u) 


(6.4) 


(6.5) 


It  Is  easy  to  check  that.  In  (6.4),  the  co- 
efficients {a.Q,0£lj<n)  and  {aoj,0^£m)  have  already 
been  matched.  Similarly,  In  (6.4),  the  coeffici- 
ents {b^ot  0<l£n>  and  (boj,  0^£m}  have  already 
been  matched.  Therefore,  only  2nm  coefflcelnts 
{ax4.  l<l£n  , l£)£m)  and  (b^j  , l^l£n  , l£j£m}  are 
to  Be  matched.  In  other  words,  there  are  totally 
Znm  (nonlinear)  equations  to  be  satisfied.  Colncl- 
dently,  the  number  of  free  parameters  In  matrices 
Ai2  and  Azx  is  also  2nm.  Therefore  It  Is  natural 
to  conjecture  that  a solution  (or,  more  precisely, 
a finite  number  of  solutions)  should  always  exist. 

Mow  let  us  examine  the  plausibility  of  this 
conjecture  by  taking  a low-order  example.* 

Example  6.1  (1.1)  order  case 

For  ease  of  notation,  let  A^z  ~ o , Azi  - B. 
Also  (without  loss  of  generality)  let  us  assume 
that  bxo  1*  0 (otherwise,  we  may  have  to  use  another 
canonical  form) . Then  (4)  becomes 

swfa-,.  t+a,-j- w-dS  - suH-aQi- i+aio»wfaii  or  equiva- 


lently 

(6.6) 


oB  - -an 

and  (6.5)  becomes 

»»oi‘**»io'^<“io‘’oi**oi*'io“*‘’oi«  “ '»01*+*»10‘^*‘ll 


or 


(6.7) 


2b,«  ^•’I0"“01**10"*10’*01“''^'*ir*10*’l0"“l0*’01^ 


'10 


■^•ll*’01**10^ 


B< 


::ii 

o 


(6.8) 


Therefore,  the  existence  of  (1,1)  order  state- 
space  model  has  been  proved  by  construction.  U 

Unfortunately,  (6.4)  and  (6.5)  usually  give 
a set  of  2nm  nonlinear  equations;  therefore  the 
solution  may  not  always  be  In  real  numbers.  For 
realization  with  real-gain  constraints,  we  often 
need  a realization  order  higher  than  n-ha.  To  show 
that  an  (n,m)  order  real-gain  realization  may  not 
exist.  It  Is  easiest  to  work  on  an  example. 

Example  6.2  The  problem  Is  to  show  that  there  Is 
no  (1,1)  order  real-gain  realization  for  the 
transfer  function  , 

z + w 

Ztl)  - 1 

Solution:  Let  us  assume 


"b  ol  r e” 

- B - 

_B  Oj  |_f_ 


C - Ig,  h) 


Since  aji  - -1,  B - O 
and  (6.5)  becomes 


,-l 


(eho”^  + gfo) 


(6.9) 

Then  (6.4)  la  satisfied, 

(6.10) 


S 4-  (I) 


eho  ^ + gfa 


(6.11) 

(6.12) 

(6.13) 

hV^ 


fhz  + egu) 
or  equivalently, 

fh  - 1 
eg  - 1 
0 

Now,  (6.13)  X hg  - (6.11)  X g*0  - (6.12) 

gives  2 2-1 

ta  + ho  * - 0 . 

(6.14) 

Since  (6.14)  has  no  real  number  solution,  no  (1,1) 
order  real-gain  realization  exists,  (e.g.  f - h ■ 
e-g-1  ,a--B-  /-I*) . D 

In  the  practical  aspect,  real-gain  realiza- 
tions are  much  more  desirable  than  complex 
realizations  because  the  former  are  much  easier  to 
physically  Implement.  Tlierefore  our  (2m+n)  order 
real-gain  realization  (cf.  Section  3)  arc  justi- 
fied to  be  practical  and  low .order  realizations. 
Indeed,  for  the  transfer  function  In  Example  6.2, 
the  minimal  real-gain. realization  (A,  B,  C}  can  be 
obtained  by  our  realization  method; 


-1 


0 

-1 


0 

OJ 


B' 


[l|011 

Ci|oil 


(6.15) 


^01®***!©“  " ^ir^Ol^lO'^lO^Ol  . 

Since  bjo  4 0.,  (6.6)  and  (6.7)  have  solutions 
^E.  iontag  (Univ.  of  Horida)  Independently  arrived  at 


Special  Transfer  Functions 

In  designing  digital  filter,  the  transfer 
(unction  may  bo  Intendcdly  chosen  in  a certain 
form  for  the  purpose  of  an  easier  and/or  better 


the  same  conjecture  recently  (private  communication). 


rcallzaclon.  Therefore,  It  Is  worth  mentioning 
that  some  special  types  of  transfer  function  can  be 
easily  realized  In  (n+m)  order  real-pain  realiza- 
tions. There  arc  two  Important  special  types  of 
transfer  functions: 


Remark:  In  nunny  design  problems  the  constraints 
on  numerator  are  much  weaker  than  on  denominator, 
hence  this  second  form  seems  to  have  higher  poten- 
tial in  practical  applications. 


. 1.  with  separable  denominator. 

11.  with  separable  numerator. 

Let  us  first  consider  the  separable  denominator 
case.  Assuming 


H(z 


w/  -1  -1^  u/  *1 

b(z  .111  ) _ b(z  ,u  ) 


(6.16) 


a(z  ,u  ) (z  ,6(w  ) 0'^  0 

“ n 

I 


I 


1-0  1"0 


'IJ 


z-1 


(Ojj+ajz"^+. . (8q+0j"^+.  . .+8aU"") 

then  Its  circuit  realization  Is  shown  In  Figure  6.1 


Special  Form  1 


Control ler-Observer-Tvpe  Form 


Secondly,  let  us  consider  the  separable 
numerator  case,  which  is  to  say  a syaceni  with  ■; 
transfer  function. 


" " -1  -J 

,Z  (li 


I Zb 

1-0  J-O 


IJ* 


(6.17) 


Ac  first  sight,  it  seems  quite  difficult. 
However,  In  actuality,  Che  realization  can  be 
readily  obtained  by  using  the  Inversion  rule  by 
Rung  [17].  More  precisely,  to'rcallzc  the  Inverse 
system  of  Figure  6.1,  we  first  note  chat  the  path 
"Input  — 0^  — — Input"  Is  a "feed  through" 

path  (l.e.  a path  connecting  Input  and  output  with 
only  constant  g.nlns).  The  second  step  Is  to  Invert 
sll  the  gains  and  reverse  all  the  arrows  on  the 
path  (In  our  case,  replace  bgQ  by  bQg-1).  Lastly, 
change  signs  of  the  gains  of  the  branches  which  are 
entering  this  path.  These  steps  complete  the 
realization  of  ll**(z“l,  w”^),  In  (18),  part  H the 
Inplceontatlon  Is  given. 
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Appendix!  2-D  Levinson  Alr.orlthms;  The  following 
set'  of  results  were  motivated  by  the  problem  of 
• determining  stability  of  2-D  recursive  filters.  - 

In  the  1-D  case  the  connections  between  stabllltji 
orthogonal  polynomials  and  the  Levinson  recursions 
are  by  now  well  known. 

In  the  2-0  case.  Shank  conjectured  that  the 
least-squares  inverse,  say  b(z,u),  of  an  unstable 
2-D  polynomial  a(z,u)  (of  degree  n In  z,  m 
In  w)  Is  stable,  l.e., 

n ,m  . 

E b z w*  - b(z,u)  2.  l/a(r,u)  (A.l) 
l.J-0,0  ‘J  ' 

where  b(z,w)  minimizes 

Hi  - a(z,u)b(z,w)II^  (A.2) 


peftne  ^(n,m)  . 

•j  - fyj,m yj.o^ 

as  the  column  of  the  data  array,  0 < J < n 

and  **  “ 


the  data  array  scanned  column  by  column.  Kow  the 
covariance  of  Is  given  by 

E{^(n.m)^(n,m)lj  ,^(n.m) 

where  aC"**")  is  a (n+l)  by  (n+1)  block  Toeplltz 
matrix  with  Toeplltz  block  entries  R..^  ■ 
of  size  (n*fl)  by  (irri-1)  and  R.j^  ■ r|j, 
t*kUj.  " >^k,J  Now,  let 

A 

y(n,t;n,in)  - E(y(n,i)Jy(r,8)  : 


or 

8*00  - 

with 

ioO  - [1,0,. ...0],  [1  X (2n  + l)(m+  1)] 

- “ t**00 **0m'**10’******nm^ 

and  the  Toeplltz  block  Toeplltz  matrix  d contain- 
ing the  coefficients  of  a(z,u)  such  that  .[CLb] 
it  the  vector  of  the  coefficients  of  the  product 
polynomial  [a(z,u)b(z,u)].  Then  b Is  given  by 
the  solution  of  ** 

a b - [a'a]b  - e^  Sqq  (A. 3) 

By  applying  the  Levinson  (LRU)  recursions  [19], for 
block  matrices  developed  by  Robinson  and  Wiggins 
[20]^  to  (A.  3)  b can  be  obtained  from  the  first 
column  of  the  block  solution  a B ■ [lai,0,...,0]' . 

Or  with 

w ^ [ . ,u  ] ^ 

■ 1 

b(s,w)  •"  E b,  (a)w*'  - u'b(z)  (A. A) 

1-0  *• 

■ t“' ••Si’ *31  £i  ■ • 

Using  the  property  of  the  LRW  recursions  that 
l3(z)|  has  its  roots  Inside  the  unit  circle,  the 
g.c.d.  of  (b£(z)],  vhlch  divides  |B(z)|  contains 
a subset  of  these  roots. 

We  can  therefore  conclude  that  the  nonprlraltlve 
facters  of  b(z.'.)--the  contents  In  x and  w — are 
indeed  stable. 

However  Cenin  and  Kamp  [21]  proved  that 
b(z,w),  therefore  the  primitive  factors,  arc  In 
general  not  stable  for  n,m  > 1. 

A 2-D  Levinson  Alrorlthmr  Cenin  and  Kamp  developed 
a 2-D  generalization  of  the  orthogonal  polynomials 
on  the  unit  circle.  We  give  here  an  equivalent 
recursion  In  the  time-domain  using  a stochastic 
framework  (see,  e.g.,  [19]).* 

We  consider  a finite  window  of  a scalar  2-D 
stationary  stochastic  process  (yij,  1 <[0,n],j  c[0,m]) 
with  scro  mean  and  covariance 

1— 

TAr*BagierMr*(Mif)  injcpenjently'also'developed 
such  recursions  (private  eoanxmlcstlon). 


(0,0)  < (r.s)  < (n,m),(r,s)  ¥ (n.l)J, 

0 < -t  < m (A.6) 


sdicre 


and 


<>S;g  • ' 


I im-t+1  position 

^0  (n,A)  — [x, . . . ,x,0,x, . . . ,x] 


So  that  If 
~(n,m)'  -~ 


Then 

where 


[y  (n,m:n,m) , . . , ,y  (n,4.;n,m) , . . . ,y  (r , s)  ;n,a)  ] 
y(n,t;n,m)  - y(n,i.;n,m)  - y(n,<.:n,a) 

(A.8) 


c /SM  4>  rn(***®)'  IflC*'*®)'  lrt(n»®)n 

(A.  9) 

Note  that  diagonal  entries  of  top  block  of 
Q^n,m)  equal  unity,  and  (^  denotes  Kronecker 
product.  Similarly  we  can  define 

y(k,m;n,m)  - E(y(k,m)|y(r,s) : 


(0,0)  < (r,s)  < (n,m),(r,s)  ^ (k,m) ] - (A.6') 

. . , 0 < k < n (A.7') 

also 

5(n.«)  J(n,m;n,m) , . . . ,y (k,m:n,m) , . . . ,y (0,m;n,m) ] , 

jr(k,mjn,m)  - y(k,m:n,m)  - y(k,m;n,m) 

and 


^ (A.8') 

■vAiere 

Note  that  dlssonal  entries  of  block  composed  of 
1th  j-ox,.  of  fth  block  entry  of  equal  unltv. 

Also,  the  first  columns  of  and  of  aC*'*”'' 

are  the  same.  Then  by  (A.S),  (A.8)  and  (A.8') 

£ (n ,Ta)  j j(n  (n  ,m)'  j ).y(n .m) [^(n •">) •>")  ] 

and  also,  by  (A. 6)  and  (A.  6') 

E£^("t“)[5(ntra)' ^^(nt"')]  ) , j£(n.ni)  ^^(n.in)  j 

^'fi^Dias(e(n-l),m;n,ra))@ej^,  [ (mf  1)  x (nfl)]  ^ 
c(k,m;n,m)  > 0 
e(n,-t;n,in)  > 0 . 

£(",«)  a *^0Diag(€(n,ia-l;n,m))  , 

hence 

g,(n.m)jQ(n,«)^^(n.«)j  _ je(n,«)^g(n.«)j 

are  the  2-D  Levinson  equations,  therefore  we  have 
nfnfl  auxiliary  solutions.  Also,  the  first  column 
of  Co  (ojf  ot  Qj***®)  since  they  are  the  same) 

corresponds  Co  the  2-D  causal  estimate  of  y(n,m) 
given  y(l,J)  : (0,0)  < (1,J)  < (n,m),  l.e.,  it  Is 
the  44-  predictor  of  y(n,m)  (one  quadrant- 
predictor).  The  last  column  of  Ql"*®)  Sfves  Che 
-4  predictor  and  Che  last  column  of  gives 

the  v-  predictor. 

The  Levinson  Recursions;  First  define 

(\’ij  4 {5  "i'-'i- 

Now,  observe  Chat  the  following  reorderings  hold: 

<Jn®  ® V ■ 


hence 


l(ft4l)(mfl) 

so  that 

A (J^  @ J^)  caj"  /ij"  ] t cj"  ’■'  ] 

and  we  multiply 


,(«.«)  nt***®)! 


Then 


gj(n.«)jQ*(n,m)Q*(n.m)j  _ (e*^'‘''">e*^"*"‘^](A.12) 


and 

*(n,m) 


- E*<"'">@e  , 

r '^-afl 

(we  have  used  (A0B)(C0D)  - AC0BD).  Similarly 
g4(n,m)  _ e^j0J^  Dlag(c(n,m-l;n,m)  )J^  - 


,©£*<"•"> 


Mow  define 


tf<n,«)  ^ ^...,R  (a.13) 

^(n.m)  ^ 

Now,  Che  2-D  Levinson  recursions  can  be  described 
as  follows.  Increase  In  n:  n -*  n4l,  m -*  m, 
see  FlgureAl.  *” 


(n4l,m) 


«m4r 

^(n,m)‘ 

c 

“c 

*(n,m) 

“c 

■ 

g(n.») 

g*(n,n) 

c 

^n,m) 

•“>  - j 

B 

o<"- 

Mow,  let 


j(n4l,m)  _ 
c 


g*  (n  ,m)  - l^(n  ,m)j  ^ (n  ,n)  - 1 
C C i c 

(A.  15) 


where 


\o  J«/ 

Then 

on  the  right  and  denote 

and  the 

equals 
is  Just 

^(n,m)  _ g(n,m)  ,in)g*(n,m)-l^(n,m) 

j^(n4l.m)-(n4l,«)  _ 


(A. 16) 


is  Just  obtained  by  re-normalizlng  Che  columns  of 


S • .1 

Note  1;  € (n+l,k;n»fl,n)  ■(*  0 otherwise  deleting 

the  colunu\  and  ,k*^^  row  of  , ve 

could  find  cjj!  ^ -k  " ®* 
is  a covariance  and  this  would  mean  that  the 
estimation  problem  is  singular. 

Note  2;  Similarly  ein+l,k;n+l,m)  ^ 0 otherwise 
there  would  be  c:  ■ 0.  Also 


0.  Also 


,(r+l,m) 


and  let 


_(rH-l,m) 

a. 


,(r+l,m) 


;:(n+l,m)  (n.m)  -(n+l,m)_(n,m) 


A(nf“) 

^mfl 

£<n.n) 

o: 

_ r 

>«(«.«) 

Pr 

(A.  17) 

e.tt  Secti*  o 
JiiSfl  If-iV'lO'l  — 


g(ni-l,«)  _ r^(rtl,m)  { g(iH-l,m)"j  ^ columns) 

L I J (A.18) 

where  ij  first  column  of 

Cl  e 

To  obtain  the  recursions  for  an  Increase  in  m, 
we  just  have  to  reorder  in  blocks  of  size 

(n+l)x(n+l)  then  the  roles  of  m and  n are 
exchanged  as  well  as  a and  (2^  and  we  can  use 
the  sasie  recursion  as  the  one  Just  described. 

This  version  of  the  recursion  enables  us  to 
increase  n and  m separately,  instead  of  the 
scheme  proposed  by  Cenin  and  Kanp  where  m > n. 

Note  3;  The  inversions  required  by  these  recursions 
have  additional  structure,  l.e.,  the  matrices  are 
typically  non-Toeplltz,  but  sums  of  products  of 
ToapTitz  matrices.  One  can  take  advantage  of  such 
a structure  by  using  generalized  Levinson  recursions 
[22]  to  find  a representation  of  the  inverse  of  such 
matrices  also  in  terms  of  sums  of  products  of  Toeplltz 
piatriccs.  Expr.!Sslons  with  Toeplltz  matrices, 
since  they  are  related  to  convolutions,  can  be 
evaluated  using  Fast  Fourier  Transforms  (FFT's). 

n+l  TBi-1 
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